Nonequilibrium quantum-impurities: from entropy production to information theory 
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Nonequilibrium steady-state currents, unlike their equilibrium counterparts, continuously dissi- 
pate energy into their physical surroundings leading to entropy production and time-reversal sym- 
metry breaking. This letter discusses these issues in the context of quantum impurity models driven 
out of equilibrium by attaching the impurity to leads at different chemical potentials and tempera- 
tures. We start by pointing out that entropy production is often hidden in traditional treatments 
of quantum-impurity models. We then use simple thermodynamic arguments to define the rate 
of entropy production, a. Using the scattering framework recently developed by the authors we 
show that (T has a simple information theoretic interpretation in terms of the Shannon entropy and 
KuUback-Leibler divergence of nonequilibrium distribution function. This allows us to show that 
the entropy production is strictly positive for any nonequilibrium steady-state. We conclude by 
applying these ideas to the Resonance Level Model and the Kondo model. 
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Over the last decade, it has become possible to exper- 
imentally explore quantum impurity models in nonequi- 
librium settings [ij. Quantum impurities are most of- 
ten realized using quantum dots, small pools of electrons 
confined in space. In a typical experimental set-up, a 
quantum dot is attached to multiple leads at different 
chemical potentials resulting in a nonequilibrium current 
across the dot. This opens up the exciting possibility of 
using quantum impurity models to experimentally and 
theoretically explore nonequilibrium physics. 

We focus in this paper on the case when the cur- 
rents across the dot are in a nonequilibrium steady-state 
(NESS). NESS's have been extensively studied in a vari- 
ety of physical systems including lattice models and fluid 
systems A system in a NESS continuously dissipates 
energy into its surrounding, resulting in a continuous pro- 
duction of entropy and the breaking of time-reversal sym- 
metry. This is in contrast with equilibrium steady-states 
where a persistent current can flow without producing 
entropy or dissipating energy. 

NESS's in quantum-impurity systems are usually mod- 
eled by adiabatically turning-on the interaction between 
the impurity and the leads in the far past, at a time 
to < 0, and then evolving the system in time to the 
present, t = 0. Thus a,t t < to the system is described by 
a density matrix po describing two non interacting leads 
(reservoirs) at different chemical potentials /ii and differ- 
ent temperatures Ti and the uncoupled impurity. At time 
t = to the impurity is coupled to the leads and evolves 
adiabatically according to H = Ho + 9{t — t^je^^Hi, i.e. 
at a time t it is described by a time evolved density oper- 
ator pit) = W {t,to)poU{t,to), where the evolution oper- 
ator U{t,to) corresponds to H(t). The non-equilibrium 
density matrix is used to compute non-equilibrium ex- 
pectation values (O) — Trp{t)0. This expectation value 



becomes time independent and a steady-states emerges if 
the leads are good thermal baths and the system is open. 
Namely, both the number of particles in the lead, Ni, and 
the size of the lead, L, are infinite, with the limit taken 
ab initio. The establishment of a steady state follows, 
in this language, from the existence of the open-system 
limit 1/L ^ l/l^ol 7? — > 0. In this case, the density 
matrix becomes time-independent We denoted it by 
Ps. Most treatments of the problem are based on cal- 
culating ps in various ways. A large class of theoretical 
treatments use Keldysh perturbation theory to calculate 
Ps 0,01 J while others use TBA-based approaches [![. The 
Y-operator treatments calculate ps using a recursive al- 
gorithm 6] . The scattering framework recently proposed 
by the authors uses scatteriiig theory to calculate ps in 
a time-independent manner [7[. What is common to all 
these treatments is that the time-independent noncc^ui- 
librium density matrix, ps, commutes with the Hamil- 
tonian of the system, H . This observation raises the in- 
triguing question of how a density matrix that commutes 
with the Hamiltonian capture the defining characteristics 
of nonequilibrium physics, such as energy and particle 
currents, energy dissipation and entropy production. 

In an open system it is not necessary to include ex- 
plicit mechanisms, such as phonons, that allow relax- 
ation of the high-energy electrons transferred between 
leads. Instead, energy dissipation can be effectuated by 
implementing the open-system limit. Since the size of the 
system is much larger than the turn-on time, the high- 
energy electrons transferred between leads continue with 
the same energy off to edges of the leads and " dissipate" 
their energy infinitely far away. The limit also ensures 
that once the electrons cross the impurity they can not 
return to the system, giving rise to time-reversal symme- 
try breaking. In the language of Green's functions, the 
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FIG. 1: Incoming and outgoing distribution functions 

open-system limit induces the poles in the self-energy to 
merge into a branch cut, leading to dissipative effects 
Under these circumstances the nonequilibrium physics is 
captured by scattering eigenstates - eigenstates of the 
Hamiltonian Ho + Hi defined on the open system with 
appropriate asymptotic boundary conditions Their 
existence is follows from the open-system limit by the 
Gellman-Low theorem Q 

In the time-independent pictured that emerges after 
taking the appropriate limits, time has been traded for 
space It is convenient to follow the standard steps 
to express the the impurity problem in a one dimensional 
language and "unfold" the leads One then has only 
right movers, with the incoming particles in the region 
X < and the outgoing particles in the region x > and 
the impurity at a; = 0. In this picture, the far past cor- 
responds to the region a; ^ and the far future to the 
region x ^ 0. These can be neatly described by introduc- 
ing the asymptotic incoming and outgoing single-particle 



distribution functions |12l . Il3j . Denote the distribution 



function of the incoming particles (in the region a; <C 0) 
in lead i by f[' (pa ) . After scattering off the impurity at 
X — 0, the outgoing particles in lead i are also asymptot- 
ically described {x — > oo) by a distribution function for 
the outgoing particles in lead z, f~^(j>a). The incoming 
particles from each lead can be described asymptotically 
by the Fermi function fpoiPa) at the temperature and 
chemical potential appropriate to each lead. However, 
due to the scattering at the leads, f^{pa) is no longer 
the Fermi distribution function but instead a nonequi- 
librium distribution function that encodes information 
about scattering. The distribution functions, f^{Pa), 
contain all the information about the nonequilibrium en- 
ergy and particle currents since these are computed from 
local single-particle operators. 

We now discuss the entropy production in the system. 
We begin with thermodynamic considerations, then re- 
formulated the problem in terms of non-equilibrium dis- 
tributions which emerge naturally in the scattering for- 
malism. We then relate our expressions for entropy pro- 
duction to information theoretic quantities of the under- 
lying nonequilibrium distribution functions. This latter 
formulation allows us to show that the entropy produc- 
tion is due to two underlying process, mixing and relax- 
ation for which we give explicit expressions. Finally we 
prove that the rate entropy production is strictly positive 
in the NESS. As an application of these concepts, we ex- 
plore how strong-correlations manifest themselves at the 
level of entropy production in the Kondo model. 



The thermodynamic definition of the rate of entropy 
production follows naturally from the observation that 
a quantum-impurity coupled to leads is a discontinuous 
system: the two reservoirs are connected to each other 
by a single impurity [lj|. In such a system, all entropy 
is produced in the leads and the entropy produced at 
the quantum-impurity itself is negligible. Recall that the 
differential entropy of a system, dS, is related to 5Q the 
heat that flows into or out of the system via TdS — SQ 
with T the temperature of the system. For a discontinu- 
ous system with two leads, this allows us define the rate 
of entropy production, a, as 



dS 
dt 
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where SQi is the heat that flows into lead i, and Ti is the 
temperature of lead i. The heat produced by a lead is re- 
lated to the change in energy and particle number in the 
lead by SQi — dEi — fiidNi. Furthermore, since neither 
particles nor energy cannot disappear at the quantum im- 
purity in a nonequilibrium steady-state we have the con- 
servation laws ^ = --^ and ^ = -41^, and there- 

at dt at at ' 

fore, a = - ^) ^ - - t) ^- Note that 
an important ingredient in our consideration has been 
the inclusion of implicit relaxation mechanisms (e.g. the 
open-system limit or phonons) in each lead that equilibri- 
ate high energy electrons. This allows us to characterize 
the lead « by a temperature Ti even in the presence of 
nonequilibrium currents. As a result, we shall see that 
the entropy production contains not only a mixing term 
but also a term that takes into account the effect of re- 
laxation processes. 

This expression can be related to the nonequilibrium 
currents across the dot by noting that in a NESS, the rate 
of change in energy of lead 1 is the expectation value 
of the energy current across the dot, = (Ie}^ and 
the rate of change in particle number in lead 1 is the 
expectation value of the nonequilbirum particle current, 
~ {In)- Thus, in terms of the currents across the 
dot, the rate of entropy production takes the form 
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(^A^). (2) 



For the special case, when the temperatures of the two 



leads are equal, Ti = T2 =T, one has (Tt 



where 



we have defined the voltage V = /ii — /i2- The term 
in the numerator of the last expression is the familiar 
power of an electrical circuit, P = {I)gV. Thus, for any 
quantum-impurity model where the two leads are at the 
same temperature, the rate of entropy production has 
the simple interpretation as the power across the circuit 
divided by the temperature. 

We now show how to define a directly in terms of in- 
formation theoretic quantities involving nonequilibrium 
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distribution functions introduced above. We first ex- 
press the energy and particle currents in terms of f^. 
In a steady-state the particle current (/)^ can be cal- 
culated in the time-independent picture using the re- 

w /T \ dN, r Ni(L/2)-Ni(-L/2) .,i 

lation {In) = ^ = hmi^oo ^ ' '^^/^^^ — — with 
Ni{±L/2) — Ylipa. fiiVa) the asymptotic particle num- 
ber of the outgoing_jind incoming electrons and wj? is 
the Fermi velocity [l5[. In writing this expression, we 
have used the fact that the leads are non-interacting and 
that in the time-independent picture the far past corre- 
sponds to a; ^ and the far future to x ^ 0. One can 
also define the energy current in an analogous manner by 
the expression {Ie) = ^ = liniL^oo ^^i^/^^^^^J--^!^) 

where E{±L/2) — Ylip^ ^p^ftiPa) measures the asymp- 
totic energy of the incoming and outgoing particles and 
is the energy dispersion for the free electrons. Substi- 
tuting these expressions into ^ and using the conserva- 
tion laws relating the energy and particle number in the 
two leads, one can write the rate of entropy production 
in terms of these distribution function as, 
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We proceed to interpret our results in information- 
theoretic terms and rewrite a in terms of the Shan- 
non entropy current and the KuUback-Leibler distance 
of the probability distributions f^. Doing so will allow 
us to identify to mechanism underlying entropy produc- 
tion and prove that it is strictly positive. The Shannon 
entropy, SiT[q{x)] of a probability distribution q(x) mea- 
sures the uncertainty of a random variable X that takes 
discrete values in the set {x/^} with probability q(x) and 
is defined as S'it['?] = ^ X)/3 ^(^^/j) 1^9(^/3) Iflllll- The 
relative entropy or KuUback-Leibler (KL) distance be- 
tween the distribution q{x) and s{x), 



DKh[six)\\q{x)] = y^s(xg)ln 



qixfj) 



(4) 



measures the inefficiency in assuming that the distribu- 
tion is q{x) when the true distribution is s{x) 

The entropy of a free electron bath, usually defined 
thermodynamically using the partition function, can also 
be defined by means of information theoretic ideas as the 
Shannon entropy of the Fcrmi-Dirac distribution function 

SitUfd] = - ^ fPoiPa)) In (1 - .fFoiPa)) 

Q 

- ^fFD{Pa)^'[^fFD{Pa) (5) 

a 

A short calculation shows that this definition is equiv- 
alent to the usual thermodynamic definition of entropy 
in for free electrons in thermal and chemical equilibrium 



|18| . The advantage of the Shannon entropy as compared 
to thermodynamic entropy is that it has a natural gener- 
alization to nonequilibrium systems, namely the Shannon 
entropy of the nonequilibrium distribution function. 

To rewrite the rate of entropy production in terms 
of the information theoretic quantities defined above we 
make use of the fact that the incoming particles from lead 
i are distributed according the Fermi-Dirac distribution 
function, f~{pa) — fiFoiPa)- As a result, we know that 
we can write {cp - iJLi)/Ti = ln[(l - f~ {Pa)) / {Pa)]- 
Substituting this expression into ([3]) and using the defi- 
nitions ([5]) and (|4]) one gets 



a = hm l^«^[5iT[/+]-^iT[/r]] + ^^Fi^KL[/+||/r] 

L^OO Li ^ — ^ 

i 

= ^ Aa, + VF lim \ ^KL [/+ 1 1 hFD] , (6) 

i i 

where in the second line we defined ai, the Shannon- 
entropy produced per unit time at lead i. The only as- 
sumption we used is that the leads are non-interacting. 
Thus, this expression is valid for all nonequilibrium 
quantum-impurity models with non-interacting leads 
where no entropy is produced at the impurity. 

The two terms in ([6]) have a clear physical meanings. 
A(Ti measures the increase in the entropy per unit time 
of the system due to mixing of electron between leads. 
In information theoretic terms, it measures the extra un- 
certainty about electrons introduced because electrons 
are being transferred between leads. This term does not 
however take into account the extra entropy produced 
in the physical system by the relaxation to equilibrium 
of high energy electrons transferred between leads. This 
is captured by the second term in the KL-distance 
between the nonequilibrium distribution function of the 
outgoing electrons of lead i and the thermal equilibrium 
Fermi-Dirac distribution function. Thus, in thermody- 
namic terms, we can interpret TiDKhlf^WfiFo] as the 
available work that can be extracted when a system with 
the nonequilibrium distribution function f^{p) relaxes 
to equilibrium at temperature T^. A similar interpreta- 
tion of the KL-distance has been suggested in the theory 
of nonequilibrium chemical reaction [l9|. In information 
theoretic terms, fKLl/i^H/iFc] nieasures the uncertainty 
introduced by the relaxation of high-energy electrons. 
Thus, despite the fact that, as discussed in the intro- 
duction, we have not included physical energy dissipa- 
tion mechanisms such as phonons in our system, infor- 
mation theoretic considerations still allow us to extract 
the amount of entropy produced by relaxation of high 
energy electrons to equilibrium. 

The expression ([6|) further allows us to adapt Shan- 
non's original proof that a communication device always 
increases the entropy of a message to prove that for 
a NESS, cr > 0. To do so, we view the scattering problem 
as a classical communication device where a transmitter 
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at a; ^ — cx) prepares a message - in this case the in- 
coming particles in each lead that are to be scattered - 
which is then transmitted down the communication chan- 
nel - in this case the scattering of the incoming electrons 
off the impurity resulting into outgoing particles. The 
receiver, at a; ^ oo, then receives the output of this mes- 
sage - the outgoing electrons. Note that the messages 
sent by our classical device utilize only the distribution 
functions and not the full many-body aspects of the prob- 
lem. Armed with this analogy, we apply Shannon's proof 
to conclude that the first term in ^ is greater than equal 
to zero, AS > 0, with equality if and only if /^^ — f^. 
Furthermore, by the definition of the KL-distance, we 
know that D Kj.l f ^WfiFn] > with equality if and only 
if = fiFD Thus we have proven that for a NESS, 
a > 0. 

As an application, we calculate the rate of en- 
tropy production for the Resonance Level Model 
(RLM), which describes a local level, (fi , attached 
to two leads of spin-less electrons at different 
chemical potentials. The Hamiltonian, Hrlm = 
E.=i,2 [/ 4i^)^xM^)+t{dH^{0) + h.c)+eddU'\, is 
quadratic and the entropy production rate can be eas- 
ily computed from the thermodynamic definiton ([2]) 



a ■ 



To 



■[flFoip) - f2FD{p)] 



(p - eaY + r2 ' 



(7) 



Alternatively, we can compute the entropy using the 
nonequilibrium scattering distribution functions ff cal- 
culated using the scattering method and explicitly given 
by 



ft.2 = h.2FD{p)\R{p)V + f 2,1 Fd\T{p)\' 



(8) 



the probability that a par- 



with |T(p)|2 = v- + (p-,,y^ 
tide with the energy p is transmitted across leads and 
= 1 — |T(p)p the probability that a particle stays 
in the same lead. Plugging into ([6]) and simplifying we 
again find that a is of the form ^ . 

As a final application of these ideas, we explore how the 
Kondo effect manifests itself at the level of entropy pro- 
duction. We consider the experimentally relevant case 
where the temperatures of the two leads are identical. 
The particle current in the Kondo model at V ^ is 
found to be (/), - V/\og^ ^^rt^' B^]. 
voltages a ~ V'^/log^ 



Thus, at high 
At very small voltages 



,2 yy^^T^ 

the problem can be treated by linear response around the 
strong-coupling fixed point. In the regime, T <C <C T^, 
the current is given by {20], (I)^ V — 1^ and the en- 

k ^ 

tropy production is just a = V^/T{1 — |^)- We can 
compare this at low temperatures to the RLM - which 
describes the equilibrium strong coupling Kondo physics 



- where a ~ VyT{l - ^) (taking //i,2 = ± V/2). 
Thus, as expected, from the point of view of entropy 
production, the Kondo model behaves essentially as a lo- 
cal level with hybridization proportional to the Kondo 
temperature at low voltages and temperatures. At high 
temperature the correlations weaken, leading to an in- 
crease in the rate of entropy production compared with 
the RLM. 

Nonequilibrium physics remains relatively poorly un- 
derstood compared to its equilibrium counterpart. It is 
our belief that thinking about the nonequilibrium physics 
of quantum-impurity models is likely to yield general con- 
cepts applicable to a wide variety of physical systems. In 
this letter, we have shown how entropy production in 
a NESS has a natural interpretation in terms of infor- 
mation theoretic quantities involving the nonequilibrium 
distribution function. We believe that this is the first 
step towards a broadening our understanding of the rich 
nonequilibirum phenomenon present in these models. In 
particular, in light of the close connections between quan- 
tum information theory and quantum-entanglement, it 
would be particularly interesting to understand if the 
rate of entropy production has a simple interpretation 
in terms of entanglement entropies. 
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